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(54) Robotically controlled surgical instrument 

(57) A robotic rtiedical system that provides a visual 
ndication of the force exerted by an end effector of the 
rystem. The end effector is coupled to a robotic arm that 
rJontrolled by a handle. The end -"^-^or .s msert^d 
through an incision of a patient to perform a "^'"''^^"y 
nvasL procedure. The surgeon can v.ew the proce 
du Jon a screen that is coupled to an endoscope also 
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with visual force-feedback 

inserted into the patient. The visual indicator may be a 
bar qraph displayed on the screen. The bar graph has 
individu'S bar'segments that are illuminated in accord _ 
ance with the amplitude of the force exerted by the end 
^VJo The visual force indicator provides a h.gh res- 
ItSn force feedback system for the instrument end ef- 
factor. 
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Description 

1 . FIELD OF THE INVENTION 



[0001] The present invention relates a medical robotic 
system. 

2. BACKGROUND INFORMATION 

[0002] Blockage of a coronary artery may deprive the 
heart of blood and oxygen required to sustain life. The 
blockage may be removed with medication or by an an- 
gioplasty. For severe blockage a coronary artery bypass 
graft (CABG) is perfomed to bypass the blocked area 
of the artery. CAEG procedures are typically performed 
by splining the sternum and pulling open the chest cavity 
to provide access to the heart. An incision Is made in 
the artery adjacent to the blocked area. The internal 
mammary artery is then severed and attached to the ar- 
tery at the point of incision. The internal mammary artery 
bypasses the blocked area of the aite'ryto again provide 
a full flow of blood to the heart. Splitting the sternum and 
opening the chest cavity can create a tremendous trau- 
ma to the patient. Additionally, the cracked sternum pro- 
longs the recovery period of the patient. 
[0003] Computer Motion of Goleta, California pro- 
vides a system under the trademark ZEUS that allows 
a surgeon to perfomn a minimally invasive CABG proce- 
dure. The procedure is performed with instruments that 
are inserted through small incisions in the patient's 
chest. The instruments are controlled by robotic arms. 
Movement of the robotic arms and actuation of the in- 
strument end effectors are controlled by the surgeon 
through a pair of handles and a foot pedal that are cou- 
pled to an electronic controller. Alternatively, the sur- 
geon can control the movement of an endoscope used 
to view the internal organs of the patient through voice 
commands. 

[0004] The instrument end effectors may include scis- 
sors, graspers, or other devices that apply a force to the 
patient. The handles used to move the Instruments are 
electronically coupled to the instrument end effectore. 
With an electronically coupled system there is no me- 
chanical feedback on the amount of force that is being 
applied by the end effector. Feedback is desired to allow 
the surgeon to "feel" the force being applied to the pa- 
tient. The Zeus system compensates for the lack of me- 
chanical feedback by incorporating a force sensor that 
is coupled to the end effectors and actuators in the han- 
dles. The actuators in the handles exert a force on the 
surgeon which corresponds to the amount of force being 
applied by the end effector onto the patient. 
[0005] The mechanical actuators and mechanical/ 
electrical transducers may create slight errors in the 
force feedback system. The fidelity of the feedback sys- 
tem maybe such that the force exerted on the surgeon 
is different than the force applied by the end effector For 
example, the surgeon may feel like the instrument is ap- 
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plying more force than what is actually being applied by 
the end effector. This may create complications in the 
surgical procedure. Additionally, the feedback force ex- 
erted by the handles can cause fatigue in the surgeon's 
5 hands. 

SUMMARY OF THE INVENTION 

[0006] A medical system that may include a visual in- 
10 dicator coupled to a force sensor of an end effector. The 
end effector may be coupled to a robotic amn that is cou- 
pled to a handle. 



BRIEF DESCRIPTION OF THE DRAWINGS 
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[0007] 

Figure 1 is a perspective view of a medical system; 

^0 Figure 2 is a side view of a surgical instrurrient; 

Figure 3 is a front view of a monitor screen showing 
a visual force indicator; 

25 Figure 4 is a top view of a pendent screen showing 
a graphical user interface; 

Figure 5 is a top view of the pendent screen showing 
a different graphical user interface; 
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Figures is a top view of the pendent screen showing 
a bar graph that provides a visual force indicator; 

Figure 7 is a top view of a visual force indicator. 

DETAILED DESCRIPTION 



[0008] Referring to the drawings more particularly by 
reference numbers, Figure 1 shows a system 10 that 
40 can perfomn minimally invasive surgery. In one embod- 
iment, the system 10 is used to perform a minimally in- 
vasive coronary artery bypass graft (MI-CABG) and oth- 
er anastomostic procedures. Although a MI-CABG pro- 
cedure is shown and described, it is to be understood 
45 that the system may be used for other surgical proce- 
dures. For example, the system can be used to suture 
any pair of vessels. The system 10 can be used to per- 
form a procedure on a patient 12 that is typically lying 
on an operating table 1 4. Mounted to the operating table 
50 14 is a first articulate arm 16, a second articulate arm 
1 8 and a third articulate ami 20. The articulate arms 1 6, 
1 8 and 20 are preferably mounted to the table 1 4 so that 
the arms are at a same reference plane as the patient. 
Although three articulate arms are shown and de- 
55 scribed, it is to be understood that the system may have 
any number of amis. 

[0009] The first and second articulate arms 1 6 and 1 8 
each have a surgical instrument 22 and 24, respectively, 
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coupled to robotic arms 26 and 28, respectively. The 
third articulate arm 20 includes a robotic ami 30 that 
holds and moves an endoscope 32. The Instruments 22 
and 24, and endoscope 32 are inserted through inci- 
sions cut into the skin of the patient. The endoscope has 
a camera 34 that is coupled to a television monitor 36 
which displays images of the internal organs of the pa- 
tient. The first 16, second 18, and third 20 articulate 
arms are coupled to a controller 38 which can control 
the movement of the arms. The controller 38 is connect- 
ed to an input device 40 such as a foot pedal that can 
be operated by a surgeon to move the location of the 
endoscope 28. The controller 38 contains electrical cir- 
cuits, such as a processor, to control the robotic arms 
26, 28 and 30. The surgeon can view a different portion 
of the patient by depressing a corresponding button(s) 
of the pedal 40. The controller 38 receives the input sig- 
nals) from the foot pedal 40 and moves the robotic ami 
30 and endoscope 32 in accordance with the input com- 
mands of the surgeon. The robotic arms 26, 28 and 30 
may be devices that are sold by "the assignee of the 
present invention, Computer Motion, Inc. of Goleta, Cal^ 
ifomia, under the trademark AESOP. The system is also 
described in U.S. Patent No. 5,657,429 issued-to Wang 
et al., which is hereby incorporated by reference. Al- 
though a foot pedal 40 is shown and described, it is to 
be understood that the system may have other input 
means such as a hand controller, or a speech recogni- 
tion interface. 

[001 0] The instruments 22 and 24 of the first 1 6 and 
second 18 articulate arms, respectively, are controlled 
by a pair of master handles 42 and 44 that can be ma- 
nipulated by the surgeon. The handles 42 and 44, and 
arms 16 and 18, have a master-slave relationship so 
that movement of the handles 42 and 44 produces a cor- 
responding movement of the surgical instruments 22 
and 24. The handles 42 and 44 may be mounted to a 
portable cabinet 46. The handles 42 and 46 are also 
coupled to the controller 38. The controller 38 receives 
input signals from the handles 42 and 44, computes a 
corresponding movement of the surgical instruments, 
and provides output signals to move the robotic arms 
26 and 28 and instruments 22 and 24. The entire system 
may be a product marketed by Computer Motion under 
the trademark ZEUS. The operation of the system is al- 
so described in U.S. Patent No. 5,762,458 issued to 
Wang et al. and assigned to Computer Motion, which is 
hereby incorporated by reference. 
[001 1 ] Figure 2 shows one of the surgical instruments 
22 or 24. The instruments 22 or 24 includes an end ef- 
fector 48 that is coupled to an actuator rod 50. The ac- 
tuator rod 50 is coupled to a motor 52 by an adapter 54. 
The motor 52 actuates the end effector 48 by moving 
the actuator rod 50. The actuator rod 50 is coupled to a 
force sensor 56 that can sense the force being applied 
by the end effector 48. The force sensor 56 provides an 
analog output signal that is sent to the controller shown 
in Fig. 1 . 



[0012] The adapter 54 is coupled to a gear assembly 
58 located at the end of a robotic arm 26 or 28. The gear 
assembly 58 can rotate the adapter 54 and end effector 
48. The actuator rod 50 and end effector 48 may be cou- 
5 pled to the force sensor 56 and motor 52 by a spring 
biased lever 60. The instrument 22 or 24 may be the 
same or similar to an instrument described in the '458 
patent. 

[0013] As shown in Figure 3, the monitor 36 has a 
10 screen 60 that displays a visual force indicator 62. The 
indicator 62 may be a graphic that is generated by the 
controller (38 in Fig. 1). The graphic may include a pair 
of bar graphs 64 and 66 that provide an indication of the 
amplitude of the force being exerted by instruments 22 
15 and 24, respectively. The bar graphs 64 and 66 may 
each include separate bar segments 68 that are illumi- 
nated in a sequential manner. The number of Illuminated 
bar segments 68 correspond to the force being exerted 
by the instrument. The controller 38 generates and var- 
20 ies the bar graphs 64 and 66 in response to the analog 
output signal provided by the force sensors of the instru- 
ments. For example, a greater force will increase the 
output signal. The processor will process the increased 
output signal to illuminate more bar segments 68. Like- 
ns wise, the processor will illuminate less bar segments 68 
in response to a lower output signal and instrument 
force. Although bar graphs 64 and 66 are shown and 
described, it is to be understood that the visual force 
indicator may be some other type of graphic, or video 
30 signal. 

[0014] Figure 4 shows a hand pendent 70 that can be 
used to provide inputs to the controller. The pendent 70 
can be the same device sold by Computer Motion under 
the trademark HERMES. The pendent 70 includes a 

35 screen 72 that displays a graphical user interface 
("GUI") 74. The GUI 74 may allow the operator to select • 
a function or input parameter by touching the screen 70. 
For example, as shown in Figures the GUI 74 may allow 
the operator to vary the scale between the movement 

40 of the system handles and the corresponding linear and 
rotational movement of the end effector. 
[0015] As shown in Figure 6, the pendent screen 72 
may display a pair of bar graphs 76 and 78 that corre- 
spond to the force exerted by the instruments. The bar 

45 graphs 76 and 78 may each contain bar segments 80 
that are individually illuminated in accordance with the 
instrument forces. An increase in force will illuminate 
more bar segments 80. Likewise, a lower force will de- 
crease the number of illuminated bar segments 80. 

so [0016] Figure 7 shows another embodiment that in- 
cludes a display 82 which contains a number of light 
emitting diodes ("LEDs") 84 that can be illuminated in 
accordance with the force exerted by a corresponding 
instrument. The display 82 may be a separate device 

55 mounted to any area of the system that is visually ap- 
parent to the operator. By wasy of example, the display 
82 may be coupled to the handles of the system 10. 
[0017] Providing a visual indicator that is generated 
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by an electronic controller eliminates mechanical actu- 
ators in the handles and provides a force feedback with 
a greater resolution than mechanical feedback systems 
of the prior art. Additionally, the visual system does not 
create human fatigue found in prior mechanical feed- s 
back systems. 

[0018] While certain exemplary embodiments have 
been described and shown in the accompanying draw- 
ings, it is to be understood that such embodiments are 
merely illustrative of and not restrictive on the broad in- io 
vention, and that this Invention not be limited to the spe- 
cific constructions and arrangements shown and de- 
scribed, since various other modifications may occur to 
those ordinarily skilled in the art. 



Claims 

1. A medical system, comprising: 

20 

a robotic arm; " ' 

an end effector coupled to said robotic arm; 

a force sensor coupled to said end effector; 

a handle coupled to said robotic arm; and, 

a visual force indicator coupled to said force 25 

sensor. 

2. The medical system of claim 1 , further comprising 
a monitor wherein said visual force indicator in- 
cludes a graphic displayed on said monitor 30 

3. The medical system of claim 1 , wherein said graph- 
ic varies in accordance with a change in a force 
sensed by said force sensor 

35 

4. The medical system of claim 3, wherein the graphic 
includes a bar graph. 

5. The medical system of claim 1 , wherein said visual 
force indicator is coupled to said handle. 40 

6. The medical system of claim 5, wherein said visual 
force Indicator includes a plurality of light emitting 
diodes. 

45 

7. The medical system of claim 1 , further comprising 
a pendent, wherein said visual force indicator in- 
cludes a graphic displayed on said pendent. 

8. The medical system of claim 7, wherein said graph- so 
ic varies in accordance with a change in a force 
sensed by said force sensor 

9. The medical system of claim 8, wherein the graphic 
includes a bar graph. 55 

10. A medical system, comprising: 



a robotic arm; 

an end effector coupled to said robotic arm; 
force sensor means for sensing a force applied 
by said end effector; 

a handle coupled to said robotic arm; and, 
indicator means for providing an visual indica- 
tion that correlates to the force sensed by said 
force sensor means. 

1 1 . The medical system of claim 1 0, further comprising 
a monitor, wherein said indicator means includes a 
graphic displayed on said monitor. 

12. The medical system of claim 10, wherein said 
graphic varies In accordance with a change in the 
force sensed by said force sensor means. 

13. The medical system of claim 1 2, wherein the graph- 
ic includes a bar graph. 

14. The medical system of claim 1 0, wherein said indi- 
cator means is coupled to said handle. 

15. The medical system of claim 14, wherein said indi- 
cator means includes a plurality of light emitting di- 
odes. 

16. The medical system of claim 1 0, further comprising 
a pendent, wherein said indicator means includes 
a graphic displayed on said pendent. 

17. The medical system of claim 16, wherein said 
graphic varies in accordance with a change in a 
force sensed by said force sensor means. 

18. The medical system of claim 17, wherein the graph- ' 
ic includes a bar graph. 

19. A method for providing a visual indication of a force 
exerted by an end effector of a medical robotic sys- 
tem, comprising: 

inserting an end effector through an incision in 
a patient; 

actuating the end effector to exert a force on 
the patient; 

sensing the force exerted on the patient; and, 
displaying a visual indication of the force. 

20. The method of claim 19, wherein the visual indica- 
tion is displayed on a monitor 

21 . The method of claim 20, wherein the visual indica- 
tion includes a bar graph, 

22. The method of claim 19, wherein the visual indica- 
tion Is displayed on a pendent. 
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23. The method of claim 22, wherein the visual indica- 
tion includes a bar graph. 
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